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ABSTRACT 

Over the past 10 years, there has been an increasing 
demand for educational institutions to demonstrate greater 
accountability for students' learning. Those working in 
post-secondary institutions initially felt that this did not apply to 
them, but, with the public perception of elementary, secondary, and 
postsecondary education as one system, there emerged a new interest 
among colleges and universities in accountability efforts. Now, in 
the eighth year of the assessment movement, over 40 states have 
educational mandates for measuring institutional effectiveness; all 
six accrediting regions have incorporated assessment of student 
learning as a condition for accreditation; and in a 1991 survey, 90% 
of responding colleges reported that they are doing something in the 
area of assessment. While some exemplary assessment practices can be 
identified, the majority of institutions are making "minimalist 1 ' 
efforts. There are three major difficulties in implementing 
accountability efforts at the state level: the inability of 
institutions to/produce evidence of effective performance, uneven 
inst i tutiona]^responses , and poor communication. However, one group 
of colleges has developed an action plan. A task force of 
practitioners and researchers are developing a model of effectiveness 
for two-year colleges, and have identified the following core 
effectiveness indicators: career preparation, transfer preparation, 
developmental education, general education* customized education, 
community development, and Mudent progress. Twenty-six transparency 
masters are included. (PAA) ^ 
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INSTITUTIONAL EFFECTIVENESS - A MATURING MOVEMENT 
WHERE DO WE GO FROM HERE? 

Presentation to 
Community College Consortium Fifth Summer Institute 

Madison, Wisconsin 
June 20, 1993 

Good morning to my community college colleagues from around the 
United States and Canada who are participants in and contributors toward the 
institutional effectiveness movement that has the potential to not only 
transform the public perception of higher education, but to also significantly 
enhance the teaching and learning processes of our colleges. 

As we celebrate the approaching 10th anniversary of A Nation at Risk, 
we reflect on a decade of unanticipated change in the relationship between the 
general public and the nation's educational institutions. 

In the early 1980s, Secretary of Education, Terrell Bell, used this 
research report to call our nation to arms against the "rising tide of mediocrity" 
that the report said was engulfing our public schools. We in higher education, 
if we paid attention at all, looked on with amused interest assuming this 
debate had nothing to do with us. Very quickly, the public dropped any 
separation between K-12 and higher education and looked at us as one system. 
Consequently over the past ten years, there has been an increasing interest 
and, in some cases, demand of educational institutions to demonstrate greater 
accountability for what and how much our students are learning. 

How many of us had we all been together at an educational conference 
in 1983, would have predicted that we would be in attendance at the Fifth 
Annual Summer Institute on Institutional- Effectiveness and Student Success. 



For most of us, the phrase "institutional effectiveness" was not in our 
vocabularies. Dick Alfred and I reminisced at breakfast about our introduction 
to the term. Dick recalls references out of NCHEMS in 1983-84. I was 
exposed to institutional effectiveness with the Southern Association of Colleges 
and Schools in 1984. 

Ten years later we are overwhelmed with the opportunities to 
demonstrate institutional effectiveness and accountability. 

We, who are members of the National Consortium, should feel a sense 
of pride and accomplishment about the role the Consortium has played in 
creating awareness and developing assessment skills in community college of 
America. Students of institutional effectiveness readily admit that community 
colleges are light years ahead of senior colleges. 

Our Terrell Bell - Paul Kreider - deserves our praise for his pioneering 
efforts. 

In the context of the events of the past ten years, let me use the opening 
session of the conference to explore with you the topic: 

TRANSPARENCY 

Institutional Effectiveness ■ A Maturing Movement 
Where Do We Go From Here? 

To answer the larger question, I will pose three additional questions and 
allow them to serve as an outline for my remarks. 
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TRANSPARENCY 

o Why did we begin this journey in the first place? 

o Where are we in the institutional effectiveness 
movement in 1993? 

o Where do we go from here? 
Let me begin with a definition of terms. I will use three words 
interchangeably but they are not synonymous. 
TRANSPARENCY * Accountability 
TRANSPARENCY * Institutional Effectiveness 
TRANSPARENCY * Assessment 
TRANSPARENCY * WHY 

TRANSPARENCY * Apple - Reputation vs Reality 

TRANSPARENCY * WHY? 

. Past Neglect of accountability 
. Political Initiatives 
. Accrediting agencies 
. Better teaching and learning 
. Opportunity to communicate effectiveness 
of community colleges 

I. Why did we begin this journey in the first place? 

I would like to observe that we began this journey because it was the 
right thing to do but an honest interpretation of history suggests that we 
responded to external forces. 

Since mid 1970 there has been unprecedented interest in education by 
elected officials, state agencies, the media and the public. The academic 



achievement of our students has not compared well to their counterparts in 
other nations. Costs of higher education and charges to students have 
escalated while achievement levels have plateaued or declined- We are unable 
to demonstrate to business and governmental leaders a strong and obvious 
correlation between investment and return. The focus on the effectiveness of 
education has been intensified by the economic crisis of the past four years* 

Initially the focus was on K-12 public education. In the mid 1980s 
attention turned to higher education. We assumed that the accountability 
movement did not apply to higher education. Since we have the "premier 
higher education system in world", we concluded that reform is not needed. 



TRANSPARENCY 



Assessment and higher education/Ted 
Marchese 



TRANSPARENCY * American higher education/Arthur Levine 

TRANSPARENCY * Education Summit at Univ. of 

Virginia/Kean 



TRANSPARENCY * Trust/Unnamed Governor 



TRANSPARENCY * That higher education/dire financial 

condition/Atwell 



TRANSPARENCY * Trends in State Assessment/Ewell 



II. Where are we now? 



TRANSPARENCY 



Where are we? 
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o Over 40 states have educational mandates, 

o All six regional have incorporated assessment of student learning 

as a condition of accreditation, 
o Increasing campus involvement with assessment 

♦ In all 1988, Campus Trends Survey by Ealine El-Kawas, 
55% of institutions responding reported assessment activities 
underway. 

♦ In a 1991 survey by Reid Johnson and Jim Nichols, 90% of 
colleges reported that they are doing something. 

o We are facing the most significant fiscal crisis in the history of 
higher education. Bob Atwell of ACE viewed the problem as long 
term "I don't think things will get better until sometime after the 
year 2010." 

o States are facing fiscal crises. Higher Education share of state 
funding is declining. Competition for reduced revenues between 
public education and higher education is increasing. 

o Assessment is becoming a matter of state policy. 

Ill* Where do we go from here? 

We are now in the eighth year of this process. Two-thirds (2/3) of our 
colleges and universities have reaffirmed their accreditation under the Criteria . 
Reports from the field suggest that while some exemplary practices can be 
identified, the majority of institutions are making a "minimalist" response. 

Some argue that the institutional effectiveness "thing" has run its course 

5 



and we can go back to business as usual or move on to the next management 
"fad". In fact, the most popular sessions at last year's annual meeting were 
forums on Total Quality Management, which is viewed by some as a 
replacement for institutional effectiveness. 

An official in a state with legislation mandating assessment expressed 
concern about the lack of commitment of presidents to the institutions 
response. He cited one president who had directed his institutional research 
staff, "Forget about assessment - the new thing is Total Quality Management 
(TQM)". A state university president and CAO sharply curtailed assessment 
activities after their SACS visit and first round of state-mandated institutional 
effectiveness reports saying "Now that's over, time to move assessment to the 
backburner." Those attitudes do not reflect the spirit of the Criteria for 
Accreditation or the intent of legislative inundates for accountability, 
o We are faced with three major difficulties. 

TRANSPARENCY * by Peter Ewell 'Three Difficulties in State 

Assessment" 

o We are at a fork in the road. 

TRANSPARENCY * by Kay McClenney - "Fork in the Road" 

TRANSPARENCY * by Education Commission of the States - 

"Assessment Movement" 

o One group of colleges has developed an action plan. 

6 
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TRANSPARENCY * A task force of practitioners and 

researchers are developing a model of 
effectiveness for two-year colleges. 

TRANSPARENCY * Core indicators have been identified: 



1. Career Preparation 
-Placement rate in workforce 
-Employer assessment of students 

2. Transfer Preparation 
-Number and rate who transfer 
-Performance after transfer 



3. Developmental Education 

-Success in subsequent related courses 

4. General Education 
-Demonstration of critical literacy 
-Demonstration of citizenship skills 

5. Customized Education 

-Client assessment of programs and services 

6. Community Development 

-Assessment of responsiveness to community 
needs 

-Participation rate in service area 



7. Student Progress 

-Student goal attainment 
-Persistence (Fall to Fall) 
-Program completion rate 



TRANSPARENCY * Quote by Derek Bok 



TRANSPARENCY * Quote by Lee Iacocca 
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